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ABSTRACT 



Based on the view that programs with a strong academic 
component may reduce the substantial educational disparities for American 
students from disadvantaged backgrounds or in chronically underperforming 
schools and school districts, this synthesis of research on academic 
achievement programs describes how such programs may help children and 
adolescents develop strengths and abilities in the areas of education and 
cognitive attainment, health and safety, social and emotional well-being, and 
young adult self-sufficiency. The report describes academic-oriented programs 
for youth that have a rigorous experimental evaluation or a careful 
quasi -experimental evaluation. Twelve programs are examined, all designed to 
improve academic achievement, with most participants considered to be at-risk 
of failing a grade or dropping out of school. Most programs had academic 
achievement as a component rather than the program's sole focus, were 
conducted after school, and were community-based. Experimental studies found 
that impact of academic achievement programs were mixed and varied 
considerably across programs. Programs focusing primarily on a particular 
outcome and including an academic component appeared to be more effective at 
improving that outcome than programs focused exclusively on academic 
achievement. Quasi -experimental evidence suggested that youth participating 
in programs longer and more intensively did better than those participating 
for a shorter time or less intensively, and that programs with a strong 
academic focus were more consistently effective at improving academic 
outcomes. The report identifies numerous questions for further research. The 
report concludes by asserting that although programs with at least one strong 
academic component can improve educational, health, social and emotional, and 
self-sufficiency outcomes among participants, the effects are not certain and 
sometimes no impact has been found. The report's two appendices describe the 
academic achievement programs and their evaluations, and delineate the 
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EXECUTIVE SUMMARY 

Beyond any doubt, academic achievement is important for the successful development 
of young people in contemporary American society. Research has shown that students 
who do well in school are better able to make the transition into adulthood and to 
achieve occupational and economic success. 

Children who master basic reading, writing, and mathematics skills are less likely to fail 
in school and more likely to develop the higher-order thinking skills they need to 
graduate from high school and post-secondary school. Competency in these basic 
academic skills is also necessary for finding and keeping jobs that provide a steady 
income, benefits, and opportunities for advancement. 

Unfortunately, U.S. schools vary greatly in quality. As a result, students’ skills and 
knowledge, employment readiness, and readiness for higher education also vary widely. 
While educational outcomes have improved overall during the past several decades, 
approximately one-fifth to one-third of fourth-, eighth-, and twelfth-grade students still 
perform below basic levels on the National Assessment of Educational Progress 
(NAEP) reading, writing, and mathematics assessments. With substantial disparities in 
school quality and educational inputs, as well as in educational outcomes, the United 
States is far from reaching its educational goal of leaving no child behind. 

Programs with a strong academic component may reduce these educational disparities, 
especially for students from disadvantaged backgrounds or those in chronically 
underperforming schools and school districts. This synthesis of research on academic 
achievement programs describes how such programs may help children and 
adolescents develop a broad array of strengths and abilities in the areas of education 
and cognitive attainment, health and safety, social and emotional well-being, and, as 
they move into adulthood, self-sufficiency. 

Specifically, the synthesis addresses the following questions: What do academic- 
oriented programs look like? What impacts do they have? What resources do they 
provide to promote healthy development? What positive outcomes are achievable 
through academic-oriented programs? What methods of implementation characterize 
effective programs? 

All of the programs in this synthesis have been evaluated, but not all of them with the 
same scientific rigor. Our main goal is to include program evaluations that use a 
rigorous experimental methodology to test for their impacts on youth outcomes. Few 
such impact studies exist, however, so this synthesis also includes careful quasi- 
experimental studies that provide insight into the practices of academic achievement 
programs. 

Experimental evaluations of the following programs are included: 

• Boys and Girls Clubs of America Educational Enhancement Program 
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• Children at Risk 

• Howard Street Tutoring Program 

• Quantum Opportunities Program 

• Summer Training and Education Program 

• Upward Bound 

Quasi-experimental studies of the following programs are included: 

• Foundations 

• LA’s BEST 

• Sponsor-A-Scholar 

• Texas Parks and Recreation Department After-School Programs 

• Fifth Dimension 

• University Student Athletes Tutoring Program 1 

The quasi-experimental analyses are included only in Part III, which explores best bets 
for program elements. For instance, a few studies of the Boys and Girls Clubs and 
Children at Risk programs used both experimental and quasi-experimental methods; in 
such cases, outcomes for students in the program are examined in relation to outcomes 
for control and comparison groups. 

Part I. Characteristics of Academic Achievement Programs 

All of the programs reviewed here are designed to improve academic achievement. 

Most of them target children and adolescents who are considered to be at risk of failing 
a grade or dropping out of school because of, such as low levels of parental education, 
low socioeconomic status, minority race or ethnic background, living in a high poverty 
neighborhood, and other factors. 

Academic achievement is often a component rather than the sole focus of a program. 
Thus the emphasis on academic achievement varies, as do the types of academic 
activities. Such activities include homework completion and assistance, supplemental 
academic or remediation classes, academic games and activities, educational computer 
games and activities, educational board games, and one-on-one or group tutoring. 

Other components, which may support both academic and other program goals, include 
recreational and arts and crafts activities, social and human services, cultural 
enrichment activities and field trips, recreational computer games, nutrition and health 
promotion lessons or activities, community service, employment, life and social skills 



This program, which uses university student athletes with below-basic reading skills (compared to other college students) as 
volunteer tutors for disadvantaged youth with reading problems in an effort to improve reading skills in both groups, is referred to 
here as the University Student Athletes Tutoring program. The formal name of the program is not reported in the evaluation. 
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training, mentoring, counseling, career preparation, parent workshops, and career 
planning. 

Most of the programs are after-school and are community-based rather than school- 
based. They vary in how often and for how long they provide services, as well as in 
what children and adolescents they encourage to participate. Some programs provide 
services during the summer or for one semester, for example, while others offer 
services — and encourage young people to participate in them — for up to four years. 
Although many of the programs operate after school every weekday, some are open 
only a couple of days per week. Some programs are structured informally, offering 
drop-in tutoring or academic remediation services at parents’ or students’ request. 

Other programs strongly encourage or expect all students to attend regularly and to 
participate in all program activities. 

Part II. Outcomes Positively Affected by Academic Achievement Programs 2 

Experimental studies found that impacts of academic achievement programs on child 
and youth development were generally mixed and varied considerably across programs. 

Educational Achievement and Cognitive Attainment 

Evidence shows that academic achievement programs can improve educational 
outcomes for young people who participate in them, although there is great variability 
across programs and outcomes. 

The one study that measured grade repetition found that children in academic-oriented 
programs repeated a grade significantly less often than children in control groups. One 
of two studies that measured test scores found positive impacts, while the other showed 
mixed effectiveness at improving scores. One of five studies that measured grades 
found that participation in academic programs raised students’ grades significantly 
higher than they would have been in absence of the program. Two of four studies that 
measured program impacts on high school graduation or college attendance showed 
some positive results. One of these programs improved high school graduation and 
college attendance for participants overall, while another improved them for certain 
subgroups, including low-income whites and Latinos. 

Overall, academic-oriented programs were more effective at improving academic- 
related outcomes such as reading, writing, and mathematics skills, grade progression, 
attitudes about school, high school credits earned, receipt of honors or awards, and 
engagement with school than at improving other developmental outcomes. 

Experimental evidence is limited, however, because only a few programs measured 
each outcome. 



2 



Only findings from experimental studies are reported here as “impacts.” 
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Health and Safety 

Studies indicate that academic-oriented programs which also aimed to improve health 
and safety were only sometimes effective at meeting this goal. 

One program decreased reported drug use among its participants. Two programs 
increased knowledge of contraceptives and responsible sexual practices and had 
limited success in decreasing students’ involvement in risky sexual behavior. One of 
these programs increased contraceptive use for one of two participant groups, but did 
not decrease teen pregnancy for either group. Participants in the other program did not 
report having fewer children than students in the control group in an initial follow-up, but 
had significantly fewer children one year after the end of the program. A third program 
had no impact on childbearing. 



Social and Emotional Well-Being 

Academic achievement programs showed some evidence of effectiveness at improving 
social and emotional well-being, although programs that specifically target this 
developmental outcome are more effective. 

One program found no differences in parents’ and teachers’ behavior ratings of youths 
in educational enhancement programs and those in control and comparison groups. 
Two programs had positive impacts on behavior related to delinquency (that is, selling 
drugs, involvement with police, associating with delinquent peers), while one had no 
impact on such behaviors (specifically, gang membership, contact with the juvenile 
justice system agencies, and behavioral incidents). One program increased youths’ 
involvement in positive social activities, while another improved students’ attitudes and 
behaviors, as measured by higher rates of volunteering and positive attitudes regarding 
the future, school, and helping the elderly. More research is necessary to understand 
the impact that participation in academic-oriented programs may have on social and 
emotional outcomes. 

Self-Sufficiency 

Academic achievement programs showed mixed effectiveness at improving self- 
sufficiency in young adulthood. 

Only two academic programs reviewed here measured self-sufficiency, and both of 
them had improving self-sufficiency as a goal. One program improved involvement in 
productive activities such as employment, school, and community service after the 
program ended. The other had no impact on employment or wages earned from 
employment, and no impact on welfare receipt. Again, more research is needed to 
understand the impact that participation in academic-oriented programs may have on 
self-sufficiency in early adulthood. 
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Summary of Program Findings 

In sum, the academic achievement programs included in this synthesis show some 
promising findings. Some have improved academic achievement and other educational 
outcomes. Some have improved social and emotional, health, and self-sufficiency 
outcomes as well. However, programs that focus primarily on one of these three 
outcomes and include an academic component appear to be more effective at 
improving them than are programs focused exclusively on academic achievement. 

More research is necessary to state definitively whether and how academic-oriented 
programs affect educational, social and emotional, health and safety, and self- 
sufficiency outcomes. 

Part III. Program and Participant Characteristics Associated with Positive 
Outcomes 

Quasi-experimental evidence from several studies suggests that young people who 
participate in programs longer and more intensively do better than those who participate 
for a shorter time or less intensively. Findings of one such study suggest that the 
development of close tutoring and mentoring relationships improves academic 
outcomes. Quasi-experimental studies also suggest that programs with a strong 
academic focus are more consistently effective at improving academic achievement 
outcomes. 

Part IV. Unanswered Questions 

People who want to implement academic-oriented programs need research that 
evaluates and systematically compares programs. Such studies should examine the 
impacts of various program components on subgroups of students. The following 
questions have not been — but need to be — adequately answered: 

• What program components work? 

• Are some activities more effective than others? 

• Are academic tutoring, homework assistance, and/or classroom-like lessons more 
effective than a broader approach? 

• Is one academic approach more effective than others? 

• Are academic programs effective as a stand-alone intervention? 

• For which outcomes are academic-oriented programs most effective? 

• Are programs that match their activities or lessons to lessons learned in school more 
effective than programs that try to seem less like school? 

• Do programs that use different teaching methods or approaches help students who 
may have difficulty learning in the regular school environment? 

• Does the effectiveness of academic-oriented programs vary by student group or 
initial degree of risk? 

• How can quality of tutoring or programming be assessed? 

• Can interested parties agree upon standards for assessing best practices and 
characteristics of effective teaching methods and program activities? 




iM m ww j i te a 

mm 



The Edna McConnell Clark Foundation 




10 



Academic Achievement Synthesis x 



• How much training and ongoing support for tutors, volunteers, and program staff is 
needed to achieve good outcomes? 

• What is the optimal frequency and duration of participation? 

• What degree and type of interaction between regular school teachers and program 
activity leaders helps improve student outcomes? 

• What do high-quality academic achievement programs cost? How does their cost 
compare with the costs of other program interventions? 

This synthesis suggests that programs with at least one strong academic component 
can improve educational, health, social and emotional, and self-sufficiency outcomes 
among participants. However, impacts are not certain, and sometimes no impacts have 
been found. Clearly, much remains to be learned. 
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INTRODUCTION 

Academic achievement is essential for young people's successful development. 

Children and adolescents who do well in school are more likely to make a successful 
transition to adulthood. Short-term outcomes promoted by successful academic 
performance include attainment of a high school diploma, enhanced social and 
emotional well-being, and avoidance of unhealthful or unsafe behavior. Long-term 
outcomes include attendance at post-secondary schools, the attainment of a college or 
higher degree, and improved social and economic status in adulthood (Murnane, 1994). 

Unfortunately, schools and school districts in the United States vary greatly in quality. 

As a result, students exhibit a wide range of skills and knowledge, employment 
readiness, and readiness for higher education and training. While educational 
outcomes have gradually improved over the past few decades (National Center for 
Education Statistics, 2000) systemic academic problems persist. Therefore, out of 
school academic achievement programs may be essential to improving students’ 
academic achievement. 

The Importance of Academic Achievement in Youth Development 

Research on youth development poses a series of specific practical questions: What do 
children and adolescents need for healthy development? How can adults meet those 
needs? What outcomes can society realistically expect to achieve? Academic-oriented 
programs are one of the resources adults can provide to meet the developmental needs 
of young people (Figure 1). 

Academic achievement programs are designed specifically to meet young people’s 
need for “academic, information, and technological knowledge." Yet because that 
knowledge is provided by caring adults (with whom young people can establish positive 
relationships), academic programs may meet not only informational needs, but other 
basic needs as well. By providing resources to meet students' needs, academic 
achievement programs may improve educational achievement and cognitive attainment, 
social and emotional well-being, and health and safety, helping young people to 
become self-sufficient adults. Table 1 shows how academic achievement programs 
provide resources to meet children’s and adolescents' developmental needs. 
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Figure 1. Model of Youth Development 
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Training in life skills 

Training in social skills 

Moral values, responsibility, 
character expectations 

Gatekeeping, interface with 
schools and other organizations 

Routines and traditions 

Community supports and 
services, norms, future 
opportunities 



Youth Outcomes 

Health and safety Young Adult 

„ . . . .. Outcome 

Social and emotional 

well-being r Self-sufficiency 

Educational achievement 
and cognitive attainment 




The Edna McConnell Clark Foundation 



er|c 



13 



Academic Achievement Synthesis 3 



Table 1. Developmental Resources Provided by Academic Achievement 
Programs 



Resource 


Proqram Activity 


Adequate food, housing, clothing 


• 


Snack or meal provided; social service referrals for families 


Health care— acute, maintenance, and 


• 


Identification of risky behaviors, physical or mental health problems; 


preventive (physical and mental) 




health service referrals 


Love; warm, close relationships with caring 


• 


Trust, open communication, warm relationships between some tutors, 


adults 




program staff or volunteers, and program participants 


Supervision, monitoring, limit setting; 


• 


Programs designed to provide safe spaces for learning, activities with 


control, discipline 




strong supervision and limits in place 


Positive role models 


• 


An outgrowth of the tutoring relationship 




• 


Program participants see examples of careers and work ethic 




• 


Recruiting older (55+) mentors and college student volunteers 




• 


Parenting workshops 


High expectations 


• 


Program goals are high; include improving academic test scores, 
improving social and emotional and health attitudes and behaviors 
among participants. 


Education in academic skills 


• 


Tutoring 




• 


Education enrichment activities 




• 


Academic workshops 




• 


College preparation 




• 


Homework and study skills 


Training in life skills 


• 


Life skills curriculum 




• 


Workshops on practical issues such as pregnancy education 


Training in social skills 


• 


Classroom discussions on the development of competent social skills 


Moral values, responsibility, character 


• 


Youth-centered approach may encourage good character 


expectations 


9 


Community service requirement 


Gatekeeping, interface with schools and other 


• 


Program staff write recommendations 


organizations 


• 


Program staff mediate with school officials or juvenile detention 
officers 




• 


Program staff collaborate with schools, universities, or other 
community organizations 


Routines and traditions 


e 


Children encouraged to complete homework regularly and to practice 
good study skills and habits 




• 


Children encouraged to attend program regularly, follow schedule, and 
participate in performances, program pledges, songs, etc. 


Community supports and services, norms, 


• 


Summer jobs provided 


future opportunities 


• 


Social service referrals 




• 


Community role models participate in programs providing social 
capital, gateway to community 




• 


College preparation activities 




• 


Scholarships; stipends 
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Knowledge of Basic Skills 

Students who master basic reading, writing, and mathematics skills are less likely to fail 
in school and more likely to develop the higher-order thinking skills they need to 
graduate from high school and post-secondary school. Mastery of basic academic skills 
is also necessary for finding and maintaining jobs that provide a steady income, 
enabling young people to live self-sufficiently as adults. Indeed, research confirms that 
performance on adult literacy tests helps explain differences in wages (Blau and Kahn, 
2000) and that amount of schooling predicts occupational status (Sewell, Hauser, and 
Wolf, 1980). 

Competency in all academic subjects is dependent upon reading skills. Children who 
read poorly will not be able to understand textbooks or word problems. They will 
experience difficulty writing reports for classes and, later, for work. Illiterate adults are 
less able to help their children with schoolwork and may pass along their academic 
deficiencies to their children. Indeed, family background, including parents’ educational 
and cognitive attainment, is strongly correlated with children's basic verbal and 
mathematical skills (Haveman and Wolfe, 1995; Murnane, 1994; Moore, Glei, Driscoll, 
Zaslow, and Redd, forthcoming). 

Reading competency also affects fundamental life skills. Basic decision-making skills 
are limited by deficits in reading, and illiterate adults find it difficult to function in society 
(Kirsch, Jungeblut, Jenkins, and Kolstad, 1993). Getting a job, for example, is likely to 
be very difficult for anyone who cannot fill out an application because of limited reading 
or writing skills. 

Young people need to be able to communicate about mathematics and to connect 
mathematical ideas with ideas from other disciplines (National Assessment Governing 
Board, 1996). For instance, a mastery of basic mathematics is needed for household 
budgeting and for everyday tasks such as depositing money into a bank account, filling 
out a job application, and estimating total costs when shopping (Kirsch, Jungeblut, 
Jenkins, and Kolstad, 1993). Nearly 90 percent of new jobs require math proficiency 
above the high school level (Riley, 1998). One study found math skills taught through 
junior-high to be positively associated with wages at age 24 (Murnane, Wilett, and Levy, 
1995). This same study, using longitudinal data and controlling for family background 
and educational attainment, found that the effect of high school students’ basic cognitive 
skills on wage differentials later in life has increased steadily since 1976 (Murnane, 
Wilett, and Levy, 1995). 

While competency in higher-order thinking may improve young people’s chances of 
getting and keeping a job with potential for advancement, they need to develop basic 
cognitive skills simply to get and keep a job (Murnane, 1994). Furthermore, as the 
United States has become less dependent upon manual labor, many of the new low- 
skilled positions are in the service and telecommunications industries (Committee for 
Economic Development, 1998). A high school diploma or the equivalent is a minimum 
requirement for many such jobs. Because young people who lack basic academic and 
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cognitive skills have trouble getting and keeping a job, they may find it difficult to 
become economically self-sufficient as adults. Studies have found that low education 
and skill levels are associated with poverty and the receipt of government assistance 
(Boisjoly, Harris, and Duncan, 1998; Gottschalk, McLanahan, and Sandefur, 1994; 
Humboldt Literacy Project, Moore, Glei, Driscoll, Zaslow, and Redd, forthcoming). 

In recent years, the United States has moved toward competency tests for primary and 
secondary students as part of standards-based educational reform. The No Child Left 
Behind Act, which reauthorizes the Elementary and Secondary Education Act was 
passed with bipartisan support of both the House of Representatives and the Senate 
and was signed into law by President Bush on January 8, 2002; this bill requires 
students in grades 3 through 8 to be tested annually (National Education Association, 
2001; U.S. Department of Education, 2002). Some states require students to pass tests 
showing they have mastered basic academic skills, including reading, writing and 
mathematics, before they can be promoted to the next grade or graduated from high 
school (National Governors Association, 1998). Success in these examinations as well 
as in other areas, is dependent upon competency in basic cognitive and academic 
skills. 

Failure in School 

The perennial question of whether to require failing students to repeat a grade or to give 
them social promotions (promotion based on age rather than performance) has become 
a hot political issue in recent years. It is fair to say that research on the question 
presents a mixed picture. Repeating at least one grade in elementary or secondary 
school is generally a sign that a student is experiencing academic difficulty, yet 
repeating a grade, even in elementary school, is a predictor of dropping out of high 
school (Dryfoos, 1990; Roderick, 1994). Being overage for grade is a predictor of 
teenage pregnancy (Moore, Manlove, Glei, and Morrison, 1998). Though findings are 
conflicting, most studies show that being held back negatively affects subsequent 
academic performance (Karweit, 1999; Roderick, 1995; Viadero, 2000; Walters and 
Borgers, 1995). 

Little research has been done on the social and emotional effects of repeating a grade, 
but some observers believe, and evidence suggests, that failing a grade may damage 
children's social adjustment, academic self-concept, and overall self-esteem (Thomas et 
al„ 1992; Foster, 1993). Students who were held back in kindergarten and first grade, 
for example, showed less ability to function socially than students who were promoted 
(Thomas et al., 1992). Others believe that social promotion prevents children from 
taking the additional time they may need to grow academically and socially (Pierson and 
Connell, 1992). One study finds that students who were held back in sixth or seventh 
grade showed less rebellious behavior and greater attachment to school in later 
adolescence than comparable students who had received social promotions 
(Gottfredson, Fink, and Graham, 1994). Teachers’ ratings of adjustment were not 
statistically different for predominantly African American fourth graders who had been 
held back and those who had not (Reynolds, 1992). 
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The question of what to do with failing students has taken on increased importance as 
social promotions are being roundly criticized by some politicians, education reform is 
focusing increasingly on standard setting and accountability, and more states are 
requiring students to pass competency tests. Negative outcomes have resulted from 
both social promotion and grade repetition. The more important question is how best to 
promote academic success so that neither practice is used. The fundamental fact 
remains that a child is not usually held back a grade in school or socially promoted 
unless he or she has failed academically. Preventing this high rate of school failure is 
important to the healthy development of children and adolescents and to their self- 
sufficiency as young adults. 

Educational Attainment 

The substantial economic returns of education, particular post-secondary education, are 
well documented (Kane and Rouse, 1995; Miller, Mulvey, and Martin, 1995; Murnane, 
1994). Although its value has decreased in the last few decades, a high school diploma 
or its equivalent still improves the economic prospects of students who have one 
(Entwisle,1990). Human capital investments yield economic returns through 
employment and the resulting income, in turn, leads to other positive outcomes. 

Educational attainment is associated with higher rates of employment and higher 
income. Most jobs require at least a high school diploma or general equivalency 
diploma (GED) for full-time workers, and many require a college or special degree. 
Employment status among adults age 18 to 34 varies with educational level. 
Unemployment among people with less than a high school diploma is 12 percent. That 
rate is nearly twice the unemployment rate among high school graduates (6 percent) 
and eight times the rate among college graduates (1 .5 percent) (U.S. Department of 
Education, 2000). Current Population Survey data from March 1997 show that women 
with a college degree earn almost twice as much as women with a high school diploma 
or GED and that men with at least a bachelor's degree earn 1 .5 times as much as men 
with a high school diploma or GED (U.S. Department of Education, 2000). Research 
has also shown completion of some college, even one semester at a community 
college, is associated with higher average lifetime earnings (Kane and Rouse, 1995). 
The positive economic returns of education may increase over time as entry-level 
positions for low-skilled or low-educated workers in the service and other sectors are 
less likely to pay middle-income wages (Entwisle, 1990). 

People with at least a high school diploma are much less likely than those without a 
diploma or GED to need welfare or other public assistance, and when they do, they are 
likely to need it for less time (Boisjoly, Harris, and Duncan, 1998). This finding is 
particularly salient since the passage in 1996 of the welfare reform bill, the Personal 
Responsibility and Work Opportunity Reconciliation Act (PRWORA), which replaced the 
entitlement program Aid to Families with Dependent Children (AFDC) with Temporary 
Assistance for Needy Families (TANF), a welfare payment transfer program with strict 
time limits and work requirements. 
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The higher a person’s level of education, the lower the likelihood that he or she will 
become involved in crime (Freeman, 1996). Freeman argues that the collapse of the 
labor market for men with little education and few skills provides an economic incentive 
to commit crimes and may have influenced the greater involvement in criminal activity 
exhibited by this group (1996). 

The higher occupational attainment and socioeconomic status attributable in part to 
higher education are themselves associated with positive outcomes. Good health, for 
example, is linked to higher education through employment. Good jobs offer more 
extensive health benefits (including access to social and psychological resources), 
better working conditions, higher pay, and therefore a more healthful lifestyle (Ross and 
Wu, 1995). More highly educated people also report being happier and feeling more 
fulfilled in life than less highly educated people (Ross and Wu, 1995). Education is also 
related to family life. Women with less education at the time of their marriage are more 
likely to divorce than women with more education (Bumpass, Castro Martin, and Sweet, 
1991). 

While genetic factors influence academic achievement and the attainment of 
educational credentials, it is important to recognize that individual motivation, learned 
information and skills, and environmental conditions are also important factors and that 
they interact with genetic characteristics (Dickens and Flynn, 2001; Maccoby, 2002). In 
the last few decades, there has been an exaggeration of the degree to which genes 
determine an organism’s capacities, including IQ (Lewontin, 2000). The number of 
years a person attends school and the amount he or she learns, for example, are not 
only predicted by IQ, but also predictors of IQ and of successful outcomes in life 
(Neisser et al. 1996). Research confirms that mean performance on intelligence tests 
has increased more than 15 points over the past 50 years, providing evidence that 
external conditions may exert a powerful effect on IQ (Dickens and Flynn, 2001; Neisser 
et al., 1996). Nevertheless, recent research shows that nurture and nature interact 
throughout the course of development to influence developmental outcomes (Bjorklund, 
1995; Miller, 1993; Maccoby, 2002; National Research Council, 2000). 

In sum, educational attainment is strongly associated with higher occupational 
attainment and income and with less dependency on welfare. Not only does education 
confer economic benefits, the attainment of academic credentials, especially college 
degrees, is associated with improved health and social and emotional status throughout 
life. Therefore, it is important for young people to understand the importance of 
completing high school and the need for training in fields that will enable them to 
achieve and maintain a self-sufficient lifestyle. 
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Students Who Need Help with Schoolwork 

Recent Trends in Academic Performance 

Since the release of A Nation at Risk, a report by the National Commission on 
Excellence in Education (1983) documenting the poor performance of American 
students, strides have been made to improve academic achievement. Indeed, 
academic performance of students in the U.S. has gradually improved since 1983 
(Forgione, 1999), However, disparities persist among people in different income and 
racial or ethnic groups on standardized test scores, high school graduation rates, and 
college enrollment rates (National Center for Education Statistics, 2001). In addition, 
data show that although the overall gap in reading performance between white students 
and black students declined between 1971 and the late 1980s, it increased in the early 
1990s and has remained relatively stable over the rest of the decade (National Center 
for Education Statistics, 2001 ). A recent report of the National Education Goals Panel 
shows that the reading scores of the best-performing students on the NAEP have gotten 
better, while the scores of the worst-performing students have gotten worse (Barton, 
2001 ). Although the overall trend in academic achievement over the past two decades 
has been slightly positive, data show that much still needs to be done to meet the broad 
educational goal of having 
no child left behind. 

Recent Trends in Educational Attainment 

Overall educational attainment, and particularly attainment among black students, has 
increased rapidly in the past few decades. In 1999, almost 90 percent of all 25- to 29- 
year-olds had completed high school, an increase of more than 10 percent over 1971. 
The rate among white students was 93 percent in 1999, up from about 82 percent in 
1971 . The rate of black students graduating from high school increased substantially, 
from roughly 60 percent in 1971 to almost 90 percent currently. Almost 62 percent of 
Hispanic students received high school diplomas in 1999 , compared to 48.3 percent in 
1971 . Although information on educational trends is not available for all ethnic groups, 
1990 Census data showed that about 78 percent of Asian/ Pacific Islanders and 66 
percent of American Indian or Alaskan Natives age 25 and over had received high 
school diplomas (National Center for Education Statistics, 2001). 

These statistics show that the black-white gap in educational attainment has diminished 
substantially since 1971, yet there remains a large gap between the educational 
attainment of Hispanics— a rapidly growing segment of the nation’s population— and 
whites and other racial and ethnic groups. 

How Academic Achievement Programs May Meet Developmental Needs 

In the first section of this introduction, evidence is offered on why it is important for 
children and youth to achieve academically and to attain educational credentials. In the 
second section, we discussed gaps among American children in educational 
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achievement as measured by NAEP mathematics and reading scores as well as in 
educational attainment. We now turn to the focus of this synthesis, the role of 
academic-oriented nonschool programs in improving educational and other outcomes 
for young people. 

Many and varied policies and reform proposals have cropped up to deal with the 
problem of public schools that fail to teach students basic skills. These include 
mandatory teacher testing, school vouchers, more early literacy programs, closing or 
penalizing failing schools, and providing extra funds for failing schools and schools in 
very poor districts to increase teacher salaries, offering more professional development, 
decrease class size, etc. Debates over which programs and policies are most effective 
are ongoing. 

Many of the nonschool programs reviewed in this synthesis offer assistance and 
academic support needed by students who are at risk of educational failure. In addition, 
most of these programs are targeted toward the “worst-performing students." The 
additional help offered by these programs may serve to help close these gaps. While 
acknowledging the importance of parents and community in preparing children for 
school and fostering their success in school, this synthesis focuses on what nonschool 
academic-oriented programs and services can do to enhance educational achievement. 

Services include tutoring, assistance with homework, group remediation classes, and a 
variety of educational enrichment activities. Many of academic achievement programs 
are staffed by volunteer college students, senior citizens, and other caring adults. 
Nonparental adults are able to provide can support to students and encourage students 
(Hendry, Roberts, Glendinning, and Coleman, 1992) and who may serve as role models 
for them. Because these programs provide individualized attention, trained staff 
members may be able to detect learning disabilities in children. In addition, volunteers 
and program staff are better able to assist children with homework than parents who 
work during nonschool hours or who have academic deficiencies or language barriers of 
their own. 

Most of the programs in this synthesis are after-school programs, a concept that 
received bipartisan support throughout the 1990s. In 1994, the 21st Century 
Community Learning Centers, an initiative of the Clinton Administration, were 
authorized as a part of the Elementary and Secondary Education Act under Title 10, 

Part I. 3 The creation and increased funding of this program show that policymakers see 
them as a way to promote educational success. Because of the gap in educational 
outcomes among students of different racial and ethnic groups and income levels, many 
programs — and all of the programs in this synthesis — are targeted toward 
disadvantaged children, who are at risk of failing academically. 



3 The 21 s ' Century Community Learning Centers are part of a national after-school program that uses public schools as community 
safe havens that provide educational, recreational, cultural, and nutritional activities for program participants. The program is 
currently undergoing evaluation by the independent research organization Mathematica Policy Research. 
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How successful are these programs at improving educational and cognitive 
outcomes? This synthesis of program evaluations is designed to answer that 
question. This synthesis is organized into four parts. First, we describe the 
approaches taken by programs that focus on improving academic achievement. 

Second, drawing on studies that took a rigorous experimental approach to evaluation, it 
reports positive, negative, and mixed impacts of academic-based programs on 
participants. Third, it highlights the program elements that contribute to effective 
academic-based tutoring or other program activities. Finally, it presents questions 
about the structure and content of academic achievement programs that need to be 
answered through further research. 

Study Design 

All of the programs in this synthesis have been evaluated, but not all of them with the 
same scientific rigor. Those subjected to experimental scrutiny are described in terms 
of their impacts on various developmental outcomes. Our main goal is to present 
program evaluations that use a rigorous experimental methodology to test for the impact 
of program participation on youth outcomes. Few such impact studies exist, however, 
so this synthesis also includes careful quasi-experimental studies that provide insight 
into the practices of academic achievement programs. Therefore, we also include 
other careful studies that provide insight into practices of academic-based programs, 
and differentiate these from impact studies that address impacts on youth outcomes. 4 

Experimental evaluations were conducted on the following programs: 

• The Boys and Girls Clubs of America Educational Enhancement Program (BGC) 

• Children at Risk (CAR) 

• Howard Street Tutoring Program (HST) 

• Quantum Opportunities Program (QOP) 

• Summer Training and Education Program (STEP) 

• Upward Bound (UB) 

Quasi-experimental studies were conducted on the following programs: 

• Fifth Dimension (5D) 

• Foundations (FND) 

• LA’s BEST (LAB) 

• Sponsor-A-Scholar (SAS) 

• Texas Parks and Recreation Department After-School Programs (TXPR) 



4 Throughout this synthesis we will denote applicable programs abbreviated program names. Refer to Program References (at the 
end of the document) for complete references. 
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